Digito: A Fine-Grain Gesturally Controlled Virtual Musical Instrument
نویسندگان
چکیده
This paper presents Digito, a gesturally controlled virtual musical instrument. Digito is controlled through a number of intricate hand gestures, providing both discrete and continuous control of Digito’s sound engine; with the finegrain hand gestures captured by a 3D depth sensor and recognized using computer vision and machine learning algorithms. We describe the design and initial iterative development of Digito, the hand and finger tracking algorithms and gesture recognition algorithms that drive the system, and report the insights gained during the initial development cycles and user testing of this gesturally controlled virtual musical instrument.
منابع مشابه
Gesturechords: Transparency in Gesturally Controlled Digital Musical Instruments through Iconicity and Conceptual Metaphor
This paper presents GestureChords, a mapping strategy for chord selection in freehand gestural instruments. The strategy maps chord variations to a series of hand postures using the concepts of iconicity and conceptual metaphor, influenced by their use in American Sign Language (ASL), to encode meaning in gestural signs. The mapping uses the conceptual metaphors MUSICAL NOTES ARE POINTS IN SPAC...
متن کاملA Real-time Workstation for Physical Model of Multi-sensorial and Gesturally Controlled Instrument
Among different currents in musical sound synthesis the instrumental approach developed at ACROE with the CORDIS ANIMA project, needs specific computer and low level software architecture for the real-time interactive simulation. Since the very beginning of this project several real-time configuration have been designed in which the basic principles of physical modeling were implemented at a lo...
متن کاملA computer instrument based on a bioacoustic model of catacea clicks
Model-based sound synthesis generally focuses on providing tools for simulation of the sound production mechanisms in musical instruments for real-time sound synthesis. More recently, the same tools are being used for simulation of bioacoustical systems. The sound production anatomy and neurophysiology of animals are important subtopics in the study of sound in non-human animals. Although the m...
متن کاملImpaired perception of temporal fine structure and musical timbre in cochlear implant users.
Cochlear implant (CI) users demonstrate severe limitations in perceiving musical timbre, a psychoacoustic feature of sound responsible for 'tone color' and one's ability to identify a musical instrument. The reasons for this limitation remain poorly understood. In this study, we sought to examine the relative contributions of temporal envelope and fine structure for timbre judgments, in light o...
متن کاملTemporal Control In the EyeHarp Gaze-Controlled Musical Interface
In this paper we describe the EyeHarp, a new gaze-controlled musical instrument, and the new features we recently added to its design. In particular, we report on the EyeHarp new controls, the arpeggiator, the new remote eye-tracking device, and the EyeHarp capacity to act as a MIDI controller for any VST plugin virtual instrument. We conducted an evaluation of the EyeHarp Temporal accuracy by ...
متن کامل